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(54) Virtual pointing device for touchscreens 

(57) A method, apparatus, and article of manufac- 
ture direct a computer system, having at least a proces- 
sor, memory, and touchscreen, to create a virtual point- 
ing device on the touchscreen. The method includes the 
steps of measuring at least a first portion of a hand 
placed on the touchscreen, determining if at least one 



measurement of the first portion substantially matches 
any existing measurements stored in the memory, if a 
substantial match exists, reading the memory for pre- 
defined characteristics, and building a virtual pointing 
device on the touchscreen in accordance with the pre- 
defined characteristics. 
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Description 

Background of the Invention 

Field of the Invention 

The present invention relates to pointing devices 
and pointers and, more particularly but without limita- 
tion, to pointing devices for use on touchscreen sys- 
tems. 

Background Information and Description of the 
Related Art 

Conventionally, users interface with the desktop 
and operating system of their computer system using a 
"mouse". A mouse is a special hardware input device 
connected by a wire or infrared signal to the computer 
system. Typically the mouse has one or more push but- 
tons on its top and a roller on its bottom designed to roll 
along a surface next to the computer system. When the 
user moves the mouse's roller on the surface, a mouse 
pointer positioned on the computer system's display 
tracks the movement of the mouse's roller. When the 
user has positioned the pointer at a desirable location, 
such as over an object the user clicks or multiple clicks, 
depending on how the mouse is programmed, one of 
the mouse push buttons to invoke or open the object. 

The user may customize the operations of a mouse 
and mouse pointer. Through a customization menu 
maintained by some conventional operating systems, 
the user may customize, for example, the assignment 
of a single click of a first mouse button to invoke a first 
function and the assignment of a single click over a sec- 
ond mouse button to invoke a second function. Further, 
the user may customize the appearance of the mouse 
pointer on the display screen. For example, one user 
may prefer a small arrow to be the mouse pointer, while 
another user may prefer a large blinking arrow. Similarly, 
some users may prefer a fast mouse pointer (i.e., small 
movements of the mouse's roller cause large movement 
of the mouse pointer), while other users may prefer a 
slower mouse pointer. This feature is referred to as the 
"sensitivity" of the mouse pointer. 

These types of mouse and mouse pointer behaviors 
may be customized for each individual user. However, 
most operating systems provide customization for only 
one user on one system. Therefore, for a multi-user sys- 
tem, the user must re-customize the mouse from the pri- 
or setting. This typically involves the user editing a 
mouse settings file or local database that maps button 
behavior to a specific function. Some systems, such as 
X1 1 , have a special init file to do this. 

Conventional mice suffer certain disadvantages 
and limitations. For example, the mouse is bulky, fixed 
in size so that very small hands or very large hands alike 
do not properly fit over the mouse, not permanently at- 
tached to the computer system, subject to corrosion, 



and requires the user to know the specific mouse be- 
havior (e.g., which mouse button and how many clicks 
invoke a function). Accordingly, many customer oriented 
systems (e.g., ATM machines) and multi-user systems 

5 do not use mice. Rather, the trend for multi-user systems 
is to use touchscreens. 

Conventional touchscreens allow the user's finger 
or a pointing device to replace the conventional mouse 
and mouse pointer. Conventional touchscreens utilize, 

10 for example, heat sensitive, sound sensitive, pressure 
sensitive, or motion sensitive grids/detectors to detect 
a hand, finger, or object placed on the touchscreen. 
However, conventional touchscreens suffer certain lim- 
itations and disadvantages. For example, unlike a 

15 mouse pointer, fingers vary in size and, therefore, the 
desktop must place contiguous object icons and text far 
apart to accommodate the largest fingers. Also, the user 
cannot select the customization features as found in 
conventional mice and mouse pointers. 

20 Accordingly, there would be great demand for a new 
pointing device that uses touchscreen technology but 
allows object icons and text to be placed close to one 
another and allows user customization of the pointing 
device and pointer. 

25 

Summary 

Accordingly, it is an object of the present invention 
to provide a method, apparatus, and article of manufac- 
30 ture that direct a computer system, having at least a 
processor memory, and touchscreen, to create a virtual 
pointing device on the touchscreen. The method in- 
cludes the steps of measuring at least a first portion of 
a hand (e.g., the palm and fingers) placed on the touch- 
es screen, determining if at least one measurement of the 
first portion substantially matches any existing meas- 
urements stored in the memory, if a substantial match 
exists, reading the memory for pre-defined characteris- 
tics, and building a virtual pointing device on the touch- 
40 screen in accordance with the pre-defined characteris- 
tics. 

Brief Description of the Drawings 

45 Fig. 1 illustrates a conventional hardware configu- 
ration for use with the present invention. 

Fig. 2 illustrates a virtual pointing device in accord- 
ance with the present invention. 

Fig. 3 illustrates detailed logic in the form of a flow- 
so chart for performing the steps in accordance with the 
present invention. 

Fig. 4 illustrates a variation of the virtual pointing 
device illustrated in Fig. 2. 

Fig. 5 illustrates another view of the virtual pointing 
55 device shown in Fig. 2. 

Fig. 6 illustrates a menu for defining the character- 
istics of the virtual pointing device in accordance with 
the present invention. 
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Fig. 7 illustrates a shape menu, define functionality 
menu, and define pointer menu in accordance with the 
present invention. 

Fig. 8 illustrates detailed logic in the form of a flow- 
chart for performing the steps in accordance with the 
present invention. 

Fig. 9 illustrates detailed logic in the form of a flow- 
chart for performing the steps in accordance with the 
present invention. 

Detailed Description of the Preferred Embodiments 

The preferred embodiments may be practiced in 
any suitable hardware configuration that uses a touch- 
screen, such as computing system 1 00 illustrated in Fig. 
1 or, alternatively, in a laptop or notepad computing sys- 
tem. Computing system 100 includes any suitable cen- 
tral processing unit 10, such as a standard microproc- 
essor, and any number of other objects interconnected 
via system bus 12. For purposes of illustration, comput- 
ing system 100 includes memory, such as read only 
memory (ROM) 16, random access memory (RAM) 14, 
and peripheral memory devices (e.g., disk or tape drives 
20) connected to system bus 12 via I/O adapter 18. 
Computing system 100 further includes a touchscreen 
display adapter 36 for connecting system bus 12 to a 
conventional touchscreen display device 38. Also, user 
interface adapter 22 could connect system bus 12 to 
other user controls, such as keyboard 24 ; speaker 28, 
mouse 26, and a touchpad 32 (not shown). 

One skilled in the art readily recognizes how con- 
ventional touchscreens operate, how conventional 
touchscreen device drivers communicate with an oper- 
ating system, and how a user conventionally utilizes a 
touchscreen to initiate the manipulation of objects in a 
graphical user interface. For example, a user can initiate 
the display of a pull down menu by touching the touch- 
screen, and then selecting an object within that menu 
by dragging the finger down the pull down menu. 

A graphical user interface (GUI) and operating sys- 
tem (OS) of the preferred embodiment reside within a 
computer-readable media and contain a touchscreen 
device driver that allows one or more users a user to 
initiate the manipulation of displayed object icons and 
text on a touchscreen display device. Any suitable com- 
puter-readable media may retain the GUI and operating 
system, such as ROM 16, RAM 14, disk and/or tape 
drive 20 (e.g., magnetic diskette, magnetic tape, CD- 
ROM, optical disk, or other suitable storage media). 

In the preferred embodiments, the COSE™ (Com- 
mon Operating System Environment) desktop GUI in- 
terfaces the user to the AIX™ operating system. The 
GUI may be viewed as being incorporated and embed- 
ded within the operating system. Alternatively, any suit- 
able operating system or desktop environment could be 
utilized. Examples of other GUIs and/or operating sys- 
tems include X11™ (X Windows) graphical user inter- 
face, Sun's Solaris™ operating system, and Microsoft's 



Windows 95™ operating system. While the GUI and op- 
erating system merely instruct and direct CPU 10, for 
ease in explanation, the GUI and operating system will 
be described as performing the following features and 

s functions. 

Referring to Fig. 2, touchscreen 200 includes any 
conventional, suitable touchscreen that is sensitive to, 
for example, heat, pressure, or the sound of palm and 
fingerprints. In this illustration, a user has placed his/her 

10 right hand (not shown) on touchscreen 200. While any 
suitable touchscreen technology may be used, for ease 
in explanation, the preferred embodiment will be de- 
scribed as using a touchscreen that detects sound pat- 
terns. In response to the user placing his/her hand on 

15 touchscreen 200, touchscreen 200 detects the sound 
pattern of the user's hand, including the sound from 
palmprint area 21 0, thumbprint area 215, and fingerprint 
areas 220, 230, 235, and 240. Alternatively, only a por- 
tion of the hand (e.g., only fingers) and/or a unique ob- 

20 ject could be substituted for the detection of a hand print. 
Moreover, more than one hand or object can be detect- 
ed at a time. 

When touchscreen 200 detects one or more hand/ 
finger patterns similar to the one shown in Fig. 2, the OS 

25 attempts to identify the user(s). To do so, the OS meas- 
ures the distance of each fingerprint area 215, 220, 230 
and 240 from palmprint area 210, along with the X, Y 
coordinates of palmprint area 210 and the X, Y extrem- 
ities of the palmprint area 21 0. The OS defines the cross 

30 point of the leftmost and uppermost point as the first ref- 
erence point 255. The OS measures the shortest dis- 
tance from thumbprint 215 to the first reference point 
255. Similarly, the OS measures the shortest distance 
from fingerprint areas 220 and 230, respectively, to first 

35 reference point 255. 

In the same manner, the OS defines the cross point 
of the rightmost and uppermost point as the second ref- 
erence point 260, whereby the shortest distance from 
fingerprint area 240 to the second reference point 260 

40 is determined. Finally the OS measures the X and Y 
coordinates 265 and 270 of palmprint area 210. To add 
even more accuracy, the size of each fingerprint could 
be measured. 

Next, the OS searches a user file database (not 

45 shown) stored in memory for a match of the newly de- 
termined measurements with any existing measure- 
ments to determine if a stored identity exists for the 
handprint. Specifically, the OS compares the four dis- 
tance measurements and the X, Y coordinates of palm- 

50 print 210 with any existing measurements stored in the 
user file database. However, one skilled in the art real- 
izes that numerous means exists for identifying the 
handprint (or object print) of a particular user (or user's 
object) without departing from the scope and spirit of this 

55 invention. Illustratively, only the width of the palmprint 
area 2 1 0 cou Id be used to determine if a match existed. 

If the OS finds a match within a user-defined (or de- 
fault) acceptable tolerance (described herein), the OS 
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reads the user file for pre-defined customization fea- 
tures, if any, and creates a virtual pointing device under 
the hand (or a portion of the hand) positioned on touch- 
screen 200 using the pre-defined customization fea- 
tures. Therefore, the areas of touchscreen 200 under, 
for example : the user's thumb (i.e., thumbprint area 
215), fingers (i.e., fingerprint areas 220, 230, 235, and 
240), and palm (i.e. ; palmprint area 210) become "acti- 
vated", such that certain defined movements of the us- 
er's fingers, thumb, and/or palm over those "activated" 
areas cause certain functions to be invoked. However, 
if the OS does not recognize the handprint, the OS 
builds a default virtual pointing device under the hand 
or a portion of the hand using a default set of functions. 

Fig. 5 illustrates how the user(s) move and operate 
the virtual pointing device(s). As the user slides his/her 
hand over touchscreen 200 such that the hand remains 
in substantial contact with touchscreen 200, the OS de- 
tects the position of the user's moving hand on touch- 
screen 200 and, in response, continuously re-defines 
the "activated" areas of the virtual pointing device to be 
the areas under the hand (or a portion of the hand). 
Therefore, the virtual pointing device moves with and 
according to the movement of the user's hand. For ex- 
ample, if an "activated" area is initially defined as the 
area contained within the touchscreen pixel coordinates 
[X1, Y1, X2, Y2, X3, Y3, and X4, Y4] (not shown) and 
the user moves a finger from that area to the touch- 
screen pixel coordinates [X5, Y5, X6, Y6, X7, Y7, and 
X8, Y8], the "activated" area moves to those new coor- 
dinates. 

The OS positions pointer 250 near the virtual point- 
ing device (in this case, over fingerprint area 230) such 
that pointer 250 moves in lock step with the virtual point- 
ing device. Therefore, the user could, for example, move 
the virtual pointing device and, therefore, pointer 250, 
such that pointer 250 is positioned over a desired object 
icon. Alternatively, the user could merely lift his hand 
and place it at a desired location, whereby the OS would 
re-create the virtual pointing device under the user's 
hand at the new location (described herein). 

The user operates the virtual pointing device via 
movement of the user's fingers, thumb and/or palm. Il- 
lustratively, the user may invoke the "focus function" 
245, whereby an object icon positioned under pointer 
250 gains focus, by lifting his/her thumb and then plac- 
ing the thumb back on thumbprint area 215 (referred to 
as "single clicking"). Similarly, the user may invoke the 
"paste" function by lifting and replacing his/her third fin- 
ger on third fingerprint area 235. 

Each finger, palm, and thumb behavior and associ- 
ated functionality can be specially programmed, and lat- 
er reprogrammed, to invoke a specific function (de- 
scribed in more detail herein). The OS displays a dialog 
above each fingerprint/thumbprint area to indicate the 
finger behavior (a "(1)" representing a single click; a " 
(2)" representing a double click, etc.) and corresponding 
functionality (e.g., focus 245, open 257, select until re- 



lease 259 ; paste 261 and default menu 262). 

The default functionality, finger behavior and point- 
er are defined in the preferred embodiment as follows. 
A single click of the thumb on th umbprint area 215 caus- 
5 es the OS to invoke focus function 245 on any object 
icon or text positioned under pointer 250. A single click 
of a finger on fingerprint area 220 causes the OS to in- 
voke an open function 230 on any object icon or text 
positioned under pointer 250. A single click on finger- 
print area 230 invokes a select until release function 259 
on any object icon or text positioned under pointer 250, 
while a single click of fingerprint area 235 invokes a 
paste function 261 on any object icon or text positioned 
under pointer 250. Finally, a single click of fingerprint 
area 240 invokes a default menu function 263. The de- 
fault pointer 250 is in the shape of an arrow and is po- 
sitioned near fingerprint area 230. However, one skilled 
in the art readily recognizes that any combination of de- 
fault functions, pointer location, and/or finger behavior 
(e.g. , multiple clicks) could have been used to define the 
default virtual pointing device. 

Fig. 3 illustrates a flow chart containing detailed log- 
ic for implementing the preferred embodiments. At 302, 
touchscreen 200 detects sound/heat/pressure, etc., 
from a handprint (or object), or alternatively, a portion of 
a handprint. At 306, the OS reads the handprint and cal- 
culates the measurements previously described and il- 
lustrated in Fig. 2. At 310, the OS searches user files in 
a database for the handprint measurements. At 312, if 
the OS locates any existing handprint measurements 
within a default tolerance of 10% (which can later be 
changed by the user, described herein), at 320, OS 
reads all information in that user file and, at 322, draws 
a virtual pointing device under the user's hand (or por- 
tion of the hand) based on pre-defined characteristics 
found in the user file. 

At 324, the OS determines if there is any consistent 
unusual behavior for four or more seconds, such as, for 
example, failing to detect the fingerprint(s), the palm- 
print, or no handprint. If the OS detects no unusual be- 
havior, the OS performs a work event loop at 326 (see 
Fig. 9) and control returns to 324. Referring to Fig. 9, at 
902, the OS determines if any movement of the hand 
across the touchscreen has occurred and, if so, at 904 
the OS moves the virtual pointing device in accordance 
with the movement of the hand. At 906, the OS deter- 
mines if movement of a finger or thumb has occurred to 
invoke a function and, if so, at 908 the OS invokes that 
function. Control returns to 324. 

Returning to 324 of Fig. 3, if the OS detects unusual 
behavior for a certain amount of time (e.g., 4 seconds), 
at 328, the OS determines if all fingers have been lifted 
off the touchscreen while the palm remains on the touch- 
screen. Alternatively, one skilled in the art recognizes 
that many other indicators could replace the "all fingers 
lifted" indicator, such as determining if a combination of 
fingers have been lifted or determining if the palm has 
been lifted while the fingerprints remain in contact with 
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the touchscreen. If the OS determines that all fingers 
have been lifted off the touchscreen, at 330, the OS dis- 
plays a main menu 600 (see Fig. 6, described herein) 
prompting the user to provide any customization of the 
virtual pointing device. At 344, the OS displays the new 
virtual pointing device in accordance with any changes 
made at 330. 

Returning to 328, if the fingers were not detected 
as being raised while the palm remained in contact with 
the touchscreen, at 342, control is directed to Fig. 8. Re- 
ferring to Fig. 8, at 810, the OS determines if the entire 
hand (or object) has been lifted off the touchscreen. If 
the entire hand has been lifted, at 81 1 , the OS continues 
to display the virtual pointing device on the touchscreen 
in its current location for a period of time (e.g., 5 sec- 
onds) but an obvious hibernated state, meaning the fin- 
gerprint and palmprint areas will be viewed as translu- 
cent areas on the touchscreen. At 812, the OS deter- 
mines if the hand has been re-positioned on the touch- 
screen within five seconds of detecting its removal. If 
the hand has not been re-positioned on the touchscreen 
within the five seconds, control is directed to 826 (de- 
scribed herein). However, if the OS detects the hand be- 
ing re-positioned on the touchscreen within 5 seconds, 
at 81 6, the OS determines if more than one virtual point- 
ing device is concurrently being used and, if so, if more 
than one user is currently lifting his/her hand off the 
touchscreen. If not, control is directed to 322 of Fig. 3, 
whereby the OS activates and moves the virtual pointing 
identified by the user file under the re-positioned hand. 
If more than one user is concurrently lifting his/her hand 
off the touchscreen, at 820, the OS reads the handprint 
and calculates the measurements previously described 
and illustrated in Fig. 2. At 822, the OS searches the 
user files of the virtual pointing devices having a detect- 
ed lifted hand for a hand measurement match. At 823, 
if a match is not found, the OS searches the user file 
database for the user identification of one of the virtual 
pointing devices having a detected lifted hand. The OS 
then displays a dialog (not shown) asking the user if he/ 
she is the user identified by the user identification. If so, 
at 826, control is directed to 322 of Fig. 3, whereby the 
OS moves the virtual pointing device identified by the 
user file under the re-positioned hand. However, if the 
user identification does not identify the user at 825, con- 
trol returns to 823 where the OS searches the next user 
file of a virtual pointing device having a detected lifted 
hand. This process repeats until a match is found be- 
tween the user and the user identification and, therefore, 
the corresponding virtual pointing device. 

Returning to 812, if the hand has not been reposi- 
tioned on the touchscreen within 5 seconds, at 826, the 
OS continues to display the virtual pointing device in the 
obvious and hibernated state and, at 828, prompts the 
user in a dialog (not shown) if the user desires to quit. 
If the user desires to quit, control is directed to 830 
where the OS removes the virtual pointing device from 
the display. If the user does not desire to quit, at 832, 



the OS places the mouse in a "hidden hibernation", 
which means that the mouse image displayed on the 
touchscreen will begin to fade with time, but can be in- 
stantly activated when the user next touches the touch- 

5 screen. Therefore, the OS transforms the virtual point- 
ing device from obvious hibernation (e.g., displayed in 
an translucent form) to a hidden hibernation. After a user 
specified time (e.g., 30 minutes), the OS interprets the 
time delay as meaning that the virtual pointing device is 

10 no longer needed. At 836, if the OS detects a hand 
placed on the touchscreen within 30 minutes, at 840, 
the OS brings the virtual pointing device out of hidden 
hibernation, redraws it under the hand, and control re- 
turns to 324 of Fig. 3. 

15 Returning to 312 of Fig. 3, the OS determines if a 
match has been found between a measured hand 
placed on the touchscreen and any existing user files. 
If the OS detects several user files having handprint 
measurements closely matching the handprint in ques- 

20 tion, at 31 6, the OS displays in a drop down menu (not 
shown) on the touchscreen showing those users having 
the closest match. At 318, the OS waits for the user to 
select (using his other hand) from the drop down menu 
a match in user identity, or a selection indicating that no 

25 match has occurred. If a match has occurred, control is 
directed to 320 (previously described). If no match has 
occurred, control is directed to 314, where the OS dis- 
plays on the touchscreen a menu (see 510 in Fig. 5) 
asking the user to indicate if he/she desires to create a 

30 customized virtual pointing device. If the user does not 
desire to create a customized virtual pointing device, the 
OS prompts the user to place his/her hand on the touch- 
screen and, in response, the OS builds a generic virtual 
pointing device under the user's hand, as shown in Fig. 

35 5, having the default finger/palm behavior and finger- 
print functionality as previously described. 

If the user does desire to create a customized virtual 
pointing device, at 332 ; the OS opens a userfile. At 334, 
the OS stores the size of the fingerprints and palmprint 

40 in the user file. At 336, the OS calculates the distance 
between the first reference point (previously described 
and shown in Fig. 2) and the closest point to each fin- 
gerprint of the first three fingers. Additionally, the OS 
could calculate the second reference point and distance 

45 therefrom to the fourth fingerprint. At 338, the OS 
prompts the user for a user identification, virtual pointing 
device characteristics, such as the virtual pointing de- 
vice shape, pointer location, behavior and sensitivity 
and fingerprint functionality (described herein and 

50 shown in Fig. 6). At 340, the OS stores all information 
in the user file. Control is directed to 322, where the OS 
draws the virtual pointing device under the hand (or por- 
tion of the hand) based on the information stored in the 
user file. 

55 Returning to 328, the OS has detected unusual be- 
havior of a hand on the virtual pointing device. If the OS 
determines that all fingers of the hand have been lifted 
off the touchscreen, at 330 : the OS displays a main 
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menu 600 as illustrated in Fig. 6, prompting the user to 
provide any customization of the virtual pointing device. 
Referring to Fig. 6, after the OS displays the main menu 
600, the user may remove his/her hand from the touch- 
screen. 

If the user selects shape button 620, a "shape" 
menu appears (see 700 in Fig. 7) that allows the user 
to define/redefine the shape of the virtual pointing de- 
vice. Referring to shape menu 700 of Fig. 7, the OS dis- 
plays several options to the user. For example, the user 
could select a "fingers only" virtual pointing device (see 
Fig. 4, described herein) whereby only the fingers need 
to be in contact with the touchscreen to move the virtual 
pointing device, or a palm and thumb only virtual point- 
ing device, whereby only the thumb and palm need to 
be in contact with the touchscreen to move the virtual 
pointing device. In the latter case, movement of the fin- 
gers would not be assigned functionality. Additionally, "a 
thumb plus one finger" or "palm" virtual pointing device 
could be created. However, because the OS invokes the 
main menu 600 (see Fig. 6) by lifting all fingers while 
keeping the palm in contact with the touchscreen, if the 
user defines a new virtual pointing device that does not 
include the palm, the user could not later re-program the 
functionality of that special virtual pointing device. Rath- 
er, the user would have to start with a generic virtual 
pointing device to create a new device. Alternatively a 
different technique could be used to activate the main 
menu 600 without departing from the scope of the in- 
vention. 

The user may change the default accuracy toler- 
ance amount from 10% to one of a number of pre-pro- 
grammed values. To do so, the user presses accuracy 
button 702 and, in response, a drop-down list (not 
shown) of values (e.g., 4%, 8%, 20%) appears for the 
user's selection. The user enters/saves all selections by 
pressing button 704. In response, the main menu 600 
shown in Fig. 6 reappears. 

Returning to Fig. 6, if the user selects define func- 
tion button 625, a "define function" menu appears that 
allows the user to define/redefine the functionality of the 
fingerprints/palmprint areas. Specifically, define func- 
tionality menu 730 in Fig. 7 allows the user to change 
the functionality of each fingerprint and thumbprint area 
by pressing the associated button next to the appropri- 
ate finger. For example, the user has pressed button 
732, indicating that he/she desires to change the func- 
tionality of the second finger (i.e., fingerprint area 230). 
In response, the OS displays drop-down list 740 of pre- 
defined functions stored in memory. The user has se- 
lected open function 742 where, in response, the OS 
displays another drop-down list 746. The user selected 
a double click 744 of the second finger to invoke the 
open function. The user then presses save button 748 
to save the entries in the user file. In response, the main 
menu 600 shown in Fig. 6 appears. However, one skilled 
in the art readily recognizes that other changes in finger 
behavior and fingerprint area functionality may be made 



without departing from the scope and spirit of this pre- 
ferred embodiment. 

Returning to Fig. 6, if the user selects define pointer 
button 630, a "define pointer" menu appears that allows 

s the user to define/redefine the shape, sensitivity, and 
position of the pointer on the virtual pointing device. Re- 
ferring to define pointer menu 760 in Fig. 7, the user has 
a number of choices regarding the pointer. For example, 
the user can select a small, medium or large arrow, and/ 

10 or a blinking arrow. The user can also select small or 
large pointer sensitivity, and the position of the pointer 
with respect to the virtual pointing device. For example, 
the pointer may be positioned over the third finger (de- 
fault position), over the first finger, or below the palm. 

15 However, one skilled in the art readily recognizes that 
numerous changes in pointer behavior may be made 
without departing from the scope and spirit of this pre- 
ferred embodiment. 

The user presses save button 762 to save the entries 
20 and, in response, the main menu 600 appears. 

Finally, in Fig. 6, the user has the option of saving 
and exiting by pressing save/exit button 635, or cancel- 
ling all changes and returning tothe default virtual point- 
ing device by pressing cancel button 615. 
25 Referring to Fig. 4, in a second embodiment, the OS 
displays pre-determined, standard size fingerprint areas 
415, 420, 430, 435 and 440 and pointer 450 as a non- 
activated (also referred to as "obvious hibernated") vir- 
tual pointing device. The fingerprint areas are displayed 
30 in a translucent state such that object icons can be seen 
through them. To activate the virtual pointing device, the 
user places one or more fingers over a fingerprint area 
415, 420, 430, 435 or 440 on touchscreen 400. When 
the OS detects a sound pattern (or heat, pressure, etc.) 
35 over one or more of the fingerprints areas 420, 430, 435 
and 440, the OS activates the virtual pointing device, 
thereby assigning a default function to each fingerprint 
area having a finger placed over it. Therefore, the fin- 
gerprint areas not having a finger placed over them will 
40 not be activated and, as such, will not have the default 
function assigned to them until they are activated. Each 
fingerprint area may be activated at any time. 

As the user slides his/her fingers over touchscreen 
400, the OS detects the touchscreen pixel coordinates 
45 under the user's moving fingers and, in response, con- 
tinuously redefines the "activated" areas of the virtual 
pointing device to be the touchscreen areas under the 
fingers. Therefore, the virtual pointing device moves 
with and according to the movement of the user's fin- 
50 gers. 

The OS positions pointer 450 near the fingerprint 
area 420 such that pointer 450 moves in accordance 
with movement of the virtual pointing device. Therefore, 
the user could, for example, move the virtual pointing 
55 device such that pointer 450 is positioned over a desired 
object icon. Alternatively, the user could merely lift his 
hand and place it at a desired location, whereby the OS 
would re-create the virtual pointing device under the us- 



25 



30 



35 



40 



45 



50 



6 



11 



EP 0 810 515 A1 



12 



er's fingers at the new location. 

In this example, the user has placed his/her first fin- 
ger over fingerprint area 420 to activate the virtual point- 
ing device. If the user desires to resize the distance be- 
tween the fingerprint areas of the virtual pointing device, 
the user merely places a separate finger, one by one, 
over each displayed fingerprint area (thereby activating 
them) and then slides each finger outward or inward, as 
appropriate, to customize the shape of the virtual point- 
ing device. In this manner, the user customizes the size 
of the virtual pointing device to the size of h is/her fingers. 
In this way, the user may actively customize the size of 
the virtual pointing device each time he/she uses it. 

Once the user positions pointer 450 over a desired 
object icon 422, the user could : for example, single click 
his first finger over fingerprint area 420 to transfer focus 
to object icon 422. However, only generic functions (or 
previously established functions) can be used for this 
embodiment. 



Claims 

1. A method for directing a computer system, having 
at least a processor, memory, and touchscreen, to 
create a virtual pointing device on the touchscreen, 
comprising the steps of: 

measuring at least a first portion of a hand 
placed on the touchscreen; 

determining if at least one measurement of the 
first portion substantially matches any existing 
measurements stored in the memory; 

if a substantial match exists, reading the mem- 
ory for pre-defined characteristics; and 

building a virtual pointing device on the touch- 
screen in accordance with the pre-defined 
characteristics. 

2. The method according to claim 1 further comprising 
the step of: 

if a substantial match does not exist, building the 
virtual pointing device on the touchscreen in ac- 
cordance with generic characteristics. 

3. The method according to anyone of the preceding 
claims wherein the measuring step comprises the 
steps of: 

measuring a distance between a thumbprint ar- 
ea of the touchscreen under the thumb of the 
hand and a palmprint area of the touchscreen 
under the hand; and 

measuring a area of the touchscreen under the 



palmprint. 

4. The method according to anyone of the preceding 
claims wherein the measuring step comprises the 
s step of: 

measuring a distance between one or more finger- 
print areas of the touchscreen under a finger and a 
palmprint area of the touchscreen under the palm. 

10 5. The method according to anyone of the preceding 
claims wherein the measuring step comprises the 
step of: 

measuring an area of one or more fingerprint areas 
under one or more fingers. 

15 

6. The method according to anyone of the preceding 
claims wherein the determining step comprises the 
step of: 

determining if the measurements of the first portion 
20 match any existing measurements stored in a data- 
base within a percentage tolerance. 

7. The method according to anyone of the preceding 
claims wherein the step of reading the memory for 

25 pre-defined characteristics comprises the step of: 
searching the memory for size : functionality and 
pointer sensitivity data. 

8. The method according to anyone of the preceding 
30 claims wherein the building step comprises the fol- 
lowing step: 

activating at least one area on the touchscreen hav- 
ing a size and functionality in accordance with the 
pre-defined characteristics. 

35 

9. The method according to claim 8 further comprising 
the step of: 

activating the area on the touchscreen under at 
least a second portion of the hand, such that the 
40 activated area moves in accordance with move- 
ment of the second portion of the hand along the 
touchscreen. 

10. A computer system for carrying out the method ac- 
45 cording to anyone of the preceding claims. 

11. An article of manufacture comprising: 

computer readable program code means for 
50 causing a computer system, having at least a 

processor, memory, and touchscreen, to create 
a virtual pointing device, the computer readable 
program code means in the article of manufac- 
ture comprising: 

55 

computer readable program code means for 
causing the computer system to measure at 
least a first portion of a hand placed on the 
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touchscreen; 

computer readable program code means for 
causing the computer system to determine if at 
least one measurement of the first portion sub- 
stantially matches any existing measurements 
stored in the memory; 

if a substantial match exists, computer reada- 
ble program code means for causing the com- 
puter system to read the memory for pre-de- 
fined characteristics; and 

computer readable program code means for 
causing the computer system to build a virtual 
pointing device on the touchscreen in accord- 
ance with the pre-defined characteristics. 
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